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(54) rule: ELECTRONIC BOOK HAVING HIGHLIGHTING FEATURE 
(57) Abstract 

An electronic book (118) includes a book-shaped 
housing having a first housing member (102) pivotably 
connected to a second housing member (104) to open 
and close in a book-like manner. A touchscreen (130) 
displays a page of the text represented by the machine- 
readable data. A user-initiated event selecting a portion 
of the text is received by the touchscreen (130). The 
touchscreen (130) displays the poition of the text in 
a highlighted form. The processof (152) stores an 
indicator of the portion of the text to be highlighted in 
the removable machine-readable storage n»dium (136) 
to remain with the text when the removable machine- 
readable storage medium (136) is removed from the 
electronic book ( 1 1 8). 
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ELECTRONIC BOOK HAVING HIGHLIGHTING FEATURE 

Related Invention 

5 The present invention is related to the following 

invention which is assigned to the same assignee as the present 
invention : 

"System and Method for Limiting Access to a Book Card", 
having Serial No. 08/572,346, filed December 14, 1995. 
10 "Apparatus and Method for Storing and Presenting Text", 

having Serial No. 08/572,451, filed December 14, 1995. 

"Method and Electronic Book for Creating a Plurality of 
Versions of a Book", having Serial No. 08/572,4 85, filed 
December 14, 1995. 
15 "Electronic Book Diary and Method For Use Therefore", 

having Serial No. 08/572,602, filed December 14, 1995. 

•Method and Device for Inhibiting the Operation of an 
Electronic Device During Take-Off and Landing of an Aircraft", 
having Serial No. 08/572,603, filed December 14, 1995. 
20 "System for Inhibiting the Operation of an Electronic 

Device During Take-Off and Landing of an Aircraft", having 
Serial No. 08/572,484, filed December 14, 1995. 

"Method for Abridging Text", having Serial No. 08/572,834, 
filed December 14, 1995. 

2 5 "A Method of Substituting Names in an Electronic Book", 

having Serial No. 08/572,480, filed December 14, 1995. 

"System and Method of Authoring Tools for an Electronic 
Book", having Serial No. 08/572,358, filed December 14, 1995. 

"System and Method for an Automatic Library for a 

3 0 Plurality of Book Cards", having Serial No. 08/572,48 2, filed 

December 14, 1995. 

"Electronic Book and Method of Selecting a Primary Font 
and a Primary Size for Displaying Text Therewith", having 
Serial No. 08/572,407, filed December 14, 1995. 
3 5 "Electronic Book and Graphical User Interface for 

Selecting a Book to Read Therewith", having Serial No. 
08/572,406, filed December 14, 1995. 
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"Electronic Book and Graphical User Interface to Provide 
Control Thereof", having Serial No. 08/572,403, filed December 
14, 1995. 

"Electronic Book and Method of Storing at Least One Book 
5 in an Internal Machine -Readable Storage Medium", having Serial 
No. 08/572,593, filed December 14, 1995. 

**Electronic Book and Method of Annotation Therefor", 
having Serial No. 08/572,367, filed December 14, 1995. 

"Electronic Book and a Method of Displaying a Relative 
10 Position of a Current Page of a Book Therefor", having Serial 
No. 08/572,373, filed December 14, 1995. 

"Method and System for Encoding a Book for Reading Using 
an Electronic Book", having Serial No. 08/572,468, filed 
December 14, 1995. 

1 5 "Electronic Book and Method of Displaying an Animated Page 

Turn Therefor", having Serial No. 08/572,405, filed December 
14, 1995. 

"Electronic Book and Method of Controlling a Rate of 
Information Displayed Thereby", having Serial No. 08/572,372, 

2 0 filed December 14, 1995. 

"Reusable Housing and Memory Card Therefor", having Serial 
No. 08/572,413, filed December 14, 1995. 

"Electronic Book and Method of Displaying at Least One, 
Reading Metric Therefor", having Serial No. 08/572,842, filed 

2 5 December 14, 1995. 

"Electronic Book and Method of Creating a Personal Log of 
Reading Activity Therefor", having Serial No. 08/572,456, filed 
December 14, 1995. 

"Electronic Book and Method of Capturing and Storing a 

3 0 Quote Therein", having Serial No. 08/572,601, filed December 

14, 1995. 

The subject matter of the above- identified related 
inventions are hereby incorporated by reference into the 
disclosure of this invention. 

35 
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3 

Field of the Invention 

The present invention relates to electronic books having 
the look and feel of real paper books and methods of 
5 highlighting text displayed on an electronic bock. 

Background of the Invention 

Various types of hand- held electronic reading devices have 

1 0 been proposed to electronically display textual information for 

reading by a user. A typical hand-held electronic reading 
device includes a display device to display the textual 
information and a user interface which allows a user to 
navigate through the textual information and access various 
15 features of the electronic reading device. The display device 
and the user interface are incorporated in a hand-held housing 
to facilitate portability of the electronic reading device. 

Many hand- held electronic reading devices have a user 
interface in the form one or more external buttons. The 

2 0 buttons are depressed in a predetermined manner either to 

navigate through the textual information or to access various 
features of the device. However, many hand -held electronic 
reading devices implement the user interface in a manner which 
does not provide a simple, intuitive, or efficient method for 

2 5 navigating the textual information or for accessing the 

features . 

The lack of simplicity of using current hand-held 
electronic reading devices along with the lack of comfort in 
handling many of these devices result in some people preferring 

3 0 to read a real paper book rather than using a hand- held 

electronic reading device. Further, current hand- held 
electronic reading devices provide only a limited number of 
features from which the user can choose. 

3 5 Brief Description of the Drawings 

The invention is pointed out with particularity in the 
appended claims. However, other features of the invention will 
become more apparent and the invention will be best understood 



1 
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by referring to the following detailed description in 
conjunction with the accompanying drawings in which: 

FIG. 1 is a view of an embodiment of an electronic book in 
a closed position; 
5 FIG. 2 is a view of the embodiment of the electronic book 

of FIG. 1 in an open position; 

FIG. 3 is a block diagram of an embodiment of the 
electronic book; 

FIG. 4 is an illustration of various hot spot locations 

1 0 used to provide control of the electronic book to a user; 

FIG. 5 is an illustration of a library screen display 
using an embodiment of the electronic book; 

FIG. 6 is an illustration of a user -initiated event to 
open the desired book from the library screen; 
15 FIG. 7 is an illustration of a first page of a book 

displayed on an embodiment of the electronic book; 

FIG. 8 is an illustration of a title page of a book 
displayed on an embodiment of the electronic book; 

FIG. 9 is an illustration of a font selection page 

2 0 displayed on an embodiment of the electronic book; 

FIG. 10 is an illustration of the title page of the book 
which is displayed upon exiting the font selection page; 

FIG. 11 is an illustration of a system control page 
displayed in an embodiment of the electronic book; 

2 5 FIG. 12 is an illustration of the title page of the book 

which is displayed upon exiting the system control page; 

FIG. 13 is an illustration of the title page of the book 
wherein a radio frequency link option is selected; 

FIG. 14 is an illustration of the title page of the book 

3 0 wherein a pacing control option is selected by a user; 

FIG. 15 is an illustration of a pacing control page 
displayed in an embodiment of the electronic book; 

FIG. 16 is an illustration of the title page of the book 
which depicts other user-initiated options; 
3 5 FIG. 17 is an illustration of a page marked by a dog ear 

for use in embodiments of the electronic book; 

FIG. IB is an illustration of a dog ear dialog box used in 
embodiments of the electronic book; 
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FIG. 19 is an illustration of a user selecting a portion 
of a page of text; 

FIG. 20 is an illustration of an option selection dialog 
box used in embodiments of the electronic book; 
5 FIG. 21 is an illustration of an annotation display used 

in embodiments of the electronic book; 

FIG. 22 is an illustration of a marker used to indicate 
that a page has an annotation associated therewith; 

FIG. 23 is an illustration of a user selecting a set 
10 bookmark option in the option selection dialog box; 

FIG. 24 is an illustration of the page of FIG. 23 having a 
bookmark displayed thereon; 

FIG. 25 is a flow diagram of an event loop performed in an 
embodiment of the electronic book; 
15 FIG. 26 is a flow diagram of steps performed in an 

embodiment of a library graphical user interface routine for 
use in the electronic book; 

FIGS. 27 and 28 show flow diagrams of an embodiment of the 
routine to display pages of text in the electronic book; 
2 0 FIG. 29 is a flow diagram of steps performed to display a 

current page in the electronic book; 

FIG. 30 is a flow diagram of steps performed in an 
embodiment of an annotation subroutine; 

FIG. 31 is a flow diagram of steps performed in an 

2 5 embodiment of a quote capture subroutine; 

FIG. 32 is a flow diagram of steps performed in an 
embodiment of a dog ear subroutine; 

FIG. 33 is a flow diagram of steps performed in an 
embodiment of a pacing control subroutine; 

3 0 FIG. 34 is a flow diagram of steps performed in an 

embodiment of the font selection subroutine; 

FIG. 35 is a flow diagram of steps performed in an 
embodiment of the system control subroutine; and 

FIG. 36 is a flow chart of steps performed in a method of 
3 5 highlighting text in the electronic book. 
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Detailed Description of a Preferred Embodiment 

Embodiments of the present invention advantageously 
provide an electronic book which looks and feels like a real 
5 paper book, and has an improved graphical user interface 

providing a highlighting feature. Using the electronic book in 
accordance with the present invention, a user can comfortably 
read a book and highlight portions of text within the book in a 
manner similar to a real paper book. 

10 FIG. 1 is a view of an embodiment of an electronic book in 

a closed position. The electronic book has a book-shaped 
housing 100 having the look and feel of a real, paper book. 
The book-shaped housing 100 has a first housing member 102 
pivotably connected to a second housing member 104 to 

15 facilitate opening and closing in a book-like manner. The 

first housing member is partially formed by a book-like, front 
cover member 106. In a similar manner, the second housing 
member 104 is partially formed by a book-like, back cover 
member 108 . The front cover member 106 and the back cover 

2 0 member 108 are pivotably connected by a spine member 110. 

To better provide the look and feel of a real book, the 
front cover member 106 and the back cover member 108 have an 
exterior made of a material used in real book covers. Examples 
of such a material include, but are not limited to, leather, 

2 5 simulated leather, vinyl, and a woven fabric such as cotton. 

The exterior can either be permanently affixed to the front 
cover member 106 and the back cover member 108, or be in the 
form of a removable jacket. 

In addition to the front cover member 106, the first 

3 0 housing member 102 is partially defined by an enclosure 112. 

Similarly, the second housing member 104 is partially defined 
by an enclosure 114 in addition to the back cover member 108. 
When the electronic book is in the closed position, the 
enclosure 112 and the enclosure 114 have an external appearance 
3 5 of edges of pages of a real, paper book. In particular, the 
enclosures 112 and 114 define a top edge 116, a bottom edge 
118; and a foredge 120 which appear as the top edge, the bottom 
edge, and the foredge, respectively, of a real, paper book. 
The top edge 116, the bottom edge 118, and the foredge 120 are 
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recessed with respect to the front cover member 106 and the 
back cover member 108, 

FIG. 2 is a view of the embodiment of the electronic book 
of FIG. 1 in an open position. It is preferred that the first 
5 housing member 102 and the second housing member 104 be 

substantially symmetric so that the front cover member 106, the 
back cover member 108, and the spine member 110 rest 
substantially flat on a flat surface in the open position. The 
substantial symmetry makes the electronic book feel like a 

1 0 real; paper book being opened to one of its middle pages. As a 

result, the electronic book can be comfortably held and read in 
a manner consistent with a paper book. 

A touchscreen 130 is integrated in the book-shaped housing 
100 to be accessible when the book-shaped housing 100 is opened 

15 in the book-like manner. In the embodiment illustrated in FIG. 
2, the touchscreen 130 is integrated with the enclosure 114 of 
the second housing member 104. Optionally, a second 
touchscreen 132 can also be integrated in the book-shaped 
housing. As illustrated, the second touchscreen 132 can be 

20 integrated with the enclosure 112 of the first housing member 
• 102. 

The touchscreen 130 and the second touchscreen 132 each 
include a touch-sensitive panel over a display device. Behind 
the display device can be a backlighting element. 

2 5 The touchscreen 130 and the second touchscreen 132 may 

provide either a color display or a monochrome display 
depending on a particular model of the electronic book. To 
provide their touch sensitivity, the touchscreen 130 and the 
second touchscreen 132 can utilize analog resistive technology 

3 0 as is known in the art. It is noted, however, that other 

technologies for providing touch sensitivity can also be 
utilized. 

It is preferred that the touchscreen 130 and the second 
touchscreen 132 be capable of providing backlighting to allow 
3 5 use of the electronic book in poorly-lit or dimly-lit 

environments. More preferably, the touchscreen 130 is capable 
of backlighting selected portions or subsets of the entire 
touchscreen 130. Here, the electronic book can provide a 
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power-saving mode wherein only a portion of the touchscreen 130 
being viewed by a user is actively backlit. 

The book-shaped housing includes a receiving slot 134 
which physically receives a removable machine-readable storage 
5 medium 136. The removable machine-readable storage medium 136 
contains machine-readable data representative of text from a 
book. Optionally, the machine-readable data is also 
representative of graphical information within the book. It is 
noted that the term "book" should be construed broadly as any 

1 0 written or printed composition having textual information which 

is read by an individual. Hence, the term "book" should be 
inclusive of books, magazines, newspapers, or the like. 

The text and the graphical information contained in the 
removable machine-readable storage medium 136 are displayed on 
15 the touchscreen 130. The second touchscreen 132 can be 

included to display graphical information while the touchscreen 
130 displays text. As another option, the touchscreen 130 and 
the second touchscreen 132 can display neighboring pages of the 
book. Further, the touchscreen 130 and the second touchscreen 

2 0 132 can be utilized to simultaneously view two books. The 

second touchscreen 132 can also be utilized in a second level 
operating system, which is herein called an advanced reader 
graphical user interface. The functionality of the second 
touchscreen 132 can be selected by the user using a switch or 

2 5 the advanced reader graphical user interface in the electronic 

book. 

It is noted that there are a number of ways to encode the 
text and the graphical information within the book for storage 
on the removable machine-readable storage medium 136. In one 

3 0 embodiment, the removable machine-readable storage medium 136 

contains a series of pointers which point to words contained in 
a dictionary within the electronic book. Words which are not 
contained in the dictionary are located in a customized 
dictionary on the removable machine-readable storage medium 
3 5 136. In this way, the words to be presented on the touchscreen 
130 are selected with minimal storage requirements in the 
removable machine-readable storage medium 136. 

Preferably, the removable machine-readable storage medium 
136 is in the form of either a smart card or a PCMCIA card. 
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Here, the receiving slot 134 is shaped to receive either a 
smart card or a PCMCIA card. 

The book-shaped housing 100 further defines a power- 
receiving port 138 and a data-receiving port 140. The power- 
5 receiving port 138 receives a plug or other type of connector 
to supply power to the electronic book. Power supplied to the 
electronic book via the power receiving port 138 can be used to 
directly operate the electronic book or to recharge batteries 
internal to the electronic book. In one embodiment of the 
1 0 electronic book, the spine member 110 is shaped to receive a 
combination of battery cells which can be recharged via the 
power-receiving port 138. If the second touchscreen 132 is not 
used, the enclosure 112 of the first housing member 102 can be 
used to store extra batteries and/or extra book cards. 

1 5 The data port 140 is utilized to communicate signals 

representative of machine-readable data between the electronic 
book and an external device. The data port 140 can be used, 
for example, to receive machine-readable data signals 
representative of text and graphics in a book from the external 

2 0 device for storage in the electronic book. In this manner, the 

data port 140 provides an alternative to the receiving slot 134 
for receiving text and graphics of a book. Additionally, the 
data port 140 can be utilized to transmit machine-readable data 
contained within the electronic book to the external device. 

2 5 Preferably, the electronic book is automatically activated 

(i.e., automatically turns on) when in the open position, and 
is automatically deactivated (i.e. automatically turns off) 
when in the closed position. To this end, the electronic book 
can include a magnet 142 incorporated within one of the first 

3 0 housing member 102 or the second housing member, and a reed 

switch 144 incorporated within the other housing member. When 
the electronic book is in the closed position, the magnet 142 
is proximate to the reed switch 144, The magnetic field 
generated by the magnet 142 causes the reed switch 144 to 
3 5 assume a first switch position which deactivates the electronic 
book. When the electronic book is in the open position, the 
magnet 142 is distant from the reed switch 144. in absence of 
a significant magnetic field, the reed switch 144 returns to a 
second switch position which activates the electronic book. 
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It is noted that in alternative embodiments, the 
electronic book is activated and deactivated by an external 
switch or button (not specifically illustrated) rather than by 
the reed switch 144. 
5 FIG. 3 is a block diagram of an embodiment of the 

electronic book. An interface 150 receives the removable 
machine-readable storage medium 136 containing machine-readable 
data representative of text and graphics from a book. In a 
preferred embodiment of the present invention, the interface 

1 0 150 comprises a PCMCIA interface which receives a removable 

machine-readable storage medium in the form of a PCMCIA card. 
Physically, the interface 150 is proximate to the receiving 
slot 134 illustrated in FIG. 2. 

In general, it is preferred that the interface 150 be 
15 capable of receiving an external device other than a machine- 
readable storage medium. Further, it is preferred that the 
interface 150 be capable of receiving a plurality of external 
devices. To these ends, the interface 150 can comprise a 
plurality of similar interfaces, such as a plurality of PCMCIA 

2 0 interfaces. Here, the electronic book can simultaneously 

receive two or more of a PCMCIA memory card, a PCMCIA modem, or 
another PCMCIA device. 

A processor 152 is in communication with the interface 150 
to read the machine-readable data from the removable machine- 

2 5 readable storage medium 136. The processor 152 can be in the 

form of a microprocessor, a custom integrated circuit, an 
application specific integrated circuit, or a programmable 
logic array, for example. Physically, the processor 152 is 
housed within the book-shaped housing 100. 

3 0 The touchscreen 130 is in communication with the processor 

152 to display a page of the text and/or the graphics 
represented by the machine-readable data. Further, the 
touchscreen 130 acts as an input device to receive user- 
initiated events, i.e. user-initiated actions, and communicate 
3 5 these user-initiated events or actions to the processor 152. 

An internal machine-readable storage medium 154 is in 
communication with the processor 152 to support a number of 
operative features of the electronic book. The internal 
machine-readable storage medium 154 can include one or more 
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memory devices, such as a random access memory, a read-only 
memory, and/or an electronically erasable and programmable 
read-only memory (EEPROM) . 

A computer program or other form of software or firmware 
5 is stored in the internal machine-readable storage medium 154. 
The computer program directs the processor 152 to support the 
operative features of the electronic book. Preferably, the 
computer program includes an event loop that processes and 
responds to user-initiated events and actions. More 
1 0 specifically, received events are placed in an event queue in 
the internal machine-readable storage medium 154 . Each of the 
received events is processed and removed from the event queue. 
As a result, a user can initiate a number of events or actions 
without having to wait for previous actions to be processed. 

1 5 The internal machine-readable storage medium 154 can also 

include a dictionary to which pointers stored in the removable 
machine-readable storage medium 136 point. By including the 
dictionary within the electronic book, less storage space is 
required on the removable machine-readable storage medium 136 

2 0 to store the text from the book. 

Further, the internal machine-readable storage medium 154 
can contain machine-readable data representative of text and 
graphics from a book. Here, the processor 152 reads the 
machine-readable data from the internal machine-readable 

2 5 storage medium. 154 and commands the touchscreen 130 to display 

pages of the text and graphics. 

Signals are communicated between the electronic book and 
an external device via either a data interface 156 in 
communication with the processor 152, via an antenna 158 and a 

3 0 radio frequency modem 160 in communication with the processor 

152, or via an infrared transceiver 161 in communication with 
the processor. As another option, communication between the 
electronic book and the external device can be effectuated 
using either a smart communication card or a PCMCIA 
3 5 communication card received by the interface 150. Here, a 

PCMCIA modem card or a PCMCIA infrared transceiver card can be 
utilized, for example, for external communication. 

Optionally, a voice synthesizer 162 is included in the 
electronic book to provide a spoken auditory display of pages 



wo 97/22103 PCT/US96/19704 

1 2 

of the text read from either the removable machine-readable 
storage medium 136 or the internal machine-readable storage 
medium 154. In one embodiment, the processor 152 directly 
converts the text from the book into speech signals for the 
5 voice synthesizer 162. Optionally, control codes can be 

provided within the removable machine-readable storage medium 
136 to allow words to be pronounced or emphasized in different 
ways. Further, the control codes can command the words to be 
spoken in either a male voice, a female voice, or a child's 

10 voice. The synthesized voice can be sampled (such as using the 
user's voice) or can be *a computer- synthesized voice. 

As an alternative, a custom voice dictionary can be 
provided to augment a general voice dictionary stored in the 
electronic book. The customized voice dictionary can be used 

15 for alternative pronunciations, voices, and emphasis. 

The voice synthesizer 162 is either permanently integrated 
in the electronic book or is a removable accessory. To 
facilitate removability, the voice synthesizer 162 can be 
embodied within a smart card or a PCMCIA card for reception by 

2 0 the interface 150. Alternatively, the voice synthesizer 162 
can communicate with the processor 152 via an accessory 
interface bus 163. In a similar manner, the RF modem 160 
and/or the second touchscreen 132 can communicate with the 
processor 152 via the accessory interface bus 163. 

2 5 Before giving a detailed description of steps performed by 

the elements of FIG. 3 for the various embodiments of the 
present invention, a functional description of a particular 
embodiment of the electronic book will now be described. This 
embodiment is based on a single touchscreen, namely the 

3 0 touchscreen 130, to display the text and the graphics of the 

book and to allow a user to control the electronic book. It is 
noted, however, that the teachings herein can also be applied 
to a dual touchscreen embodiment which further includes the 
second touchscreen 132. Furthermore, it is noted that the 
3 5 teachings herein are not limited to the use of a touchscreen, 
and hence, can be applied to an electronic, book containing any 
type of display device (such as a liquid crystal display or a 
cathode ray tube, for example) and any type of input device 
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(such as a series of buttons, a mouse, a trackball, a lightpen, 
or a touchpad, for example). 

FIG. 4 is an illustration of various hot spot locations 
used to provide control of the electronic book to a user. A 
5 page of the text represented by the machine-readable data read 
from either the removable machine-readable storage medium 136 
or the internal machine-readable storage medium 154 is 
displayed on a display portion 168 of the touchscreen 130. The 
display portion 168 is also utilized to display graphics 
1 0 represented by the machine-readable data . 

A first hot spot. portion 170 of the touchscreen 130 is 
designated for receiving a predetermined user-initiated event 
which requests that a subsequent page of the text be displayed 
on the touchscreen 130. Hence, the first hot spot portion 17 0 

1 5 can be synonymously referred to as an "advance page portion" or 

an "advance page hot spot" for receiving an advance page event. 
In the embodiment illustrated in FIG. 4, the first hot spot 
portion 170 includes a top margin portion 172, a side margin 
portion 174, and a bottom margin portion 176 of the touchscreen 

2 0 130. The top margin portion 172 is located above the display 

portion 168, the side margin portion 174 is located beside the 
display portion 168, and the bottom margin portion 176 is 
located below the display portion 168. 

A second hot spot portion 178 of the touchscreen 130 is 

2 5 designated for receiving a predetermined user-initiated event 

which requests that a previous page of the text be displayed. 
Hence, the second hot spot portion 178 can be synonymously 
referred to as a "page back portion" or a "page back hot spot" 
for receiving a page back event. In the embodiment illustrated 

3 0 in FIG. 4, the second hot spot portion 178 is located beside 

the display portion 168 of the touchscreen 130 and opposite the 
side margin portion 174 . 

A third hot spot portion 180 of the touchscreen 130 is 
designated for receiving a predetermined user-initiated event 
3 5 which requests that a pre-marked page be displayed on the 

touchscreen 130. In the embodiment of FIG. 4, the third hot 
spot portion 180 is located in an upper portion of the 
touchscreen 130 and is shaped as a bookmark graphic 182. 
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Hence, the third hot spot portion 180 can be synonymously 
referred to as a "bookmark portion" or a "bookmark hot spot". 

A fourth hot spot portion 184 of the touchscreen 130 is 
designated for receiving a predetermined user-initiated event 
5 to close the current book being read and to request that a 
library screen be displayed on the touchscreen 130. The 
library screen is utilized by a user to select a book to read 
from a plurality of books within a library. Hence, the fourth 
hot spot portion 184 can be synonymously referred to as a 

1 0 "close book portion" or a "close book hot spot" for receiving a 

close book event. 

A fifth hot spot portion 186 of the touchscreen 130 is 
designated for receiving a predetermined user-initiated event 
which requests that the displayed page be marked. In the 
15 embodiment of FIG. 4, the fifth hot spot portion 186 is located 
in an upper corner of the touchscreen 130. In this embodiment, 
the fifth hot spot portion 186 of the touchscreen 130 is 
utilized for dog-earring pages of the book. Hence, the fifth 
hot spot portion 186 can be synonymously referred to as a "dog 

2 0 ear portion" or a "dog ear hot spot" for receiving a dog ear 

event . 

A sixth portion 188 of the touchscreen 130 is designated 
to provide a depth indication representative of how much of the 
book is left to be read. In the embodiment illustrated in FIG. 

2 5 4, the sixth portion 188 is located above the display portion 

168. The second hot spot portion 178 can be utilized in 
conjunction with the sixth portion 188 to provide the depth 
indication. 

In the embodiment of FIG. 4, the display portion 168, the 

3 0 first hot spot portion 170, the second hot spot portion 178, 

the third hot spot portion 180, the fourth hot spot portion 
184, and the fifth hot spot portion 186 are mutually exclusive 
(i.e. non-overlapping) portions of the touchscreen 130. 
However, in alternative embodiments of the present invention, 
3 5 these portions may not be mutually exclusive, and hence may 
overlap. Further, some embodiments of the present invention 
may utilize different sizes and positions for the above- 
described hot spot portions. 
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Preferably, the hot spot portions are motion sensitive so 
that a touch event, a touch- and- hold event, and a drag event 
can be sensed to initiate differing responses. For example, a 
page back event can be received in the form of a flipping 
5 motion (i.e. a short stroke) across the second hot spot portion 
178. 

FIG. 5 is an illustration of a library screen displayed 
using an embodiment of the electronic book. In a preferred 
embodiment, the library screen is displayed upon opening the 
10 electronic book or activating the electronic book. The library 
screen includes a rearward graphical book representation 200 
having a graphical spine portion 202. A forward graphical book 
representation 204 is displayed in front of the rearward 
graphical book representation 200. The forward graphical book 

1 5 representation 204 has a graphical spine portion 206 and a 

graphical front cover portion 208. A title 210 of a book 
currently being read is displayed on the forward graphical book 
representation 204. In the embodiment illustrated in FIG. 5, 
the title 210 is displayed on the graphical spine portion 206 

2 0 of the forward graphical book representation 204. 

Upon receiving a user-initiated event in which a portion 
of the rearward graphical book representation 200 is selected, 
a title of another book or books of a plurality of books in a 
library is displayed in place of the title 210 on the forward 

2 5 graphical book representation 204. In a preferred embodiment, 

the portion of the rearward graphical book representation 200 
selected in this user-initiated event is within the graphical 
spine portion 202. 

The titles of the books in the library can be obtained 

3 0 from a storage medium (which contains the books) installed in 

the electronic book. Alternatively, the titles of the books 
can be obtained by a connection to an information service 
providing books or other information in real time. As another 
alternative, the titles and the books can be accessed on demand 
3 5 from a world-wide web page. 

A user can scroll through the library of books by 
repeatedly touching the spine portion 202 with his or her 
finger 212 until a desired book title is pulled into, view. 
When the spine portion 202 is selected for a last of the 
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plurality of books, the title of the first book is displayed. 
In this manner, the user can rotate through the library of 
books until a desired book is in front. 

FIG. 6 is an illustration of a user-initiated event to 
5 open the desired book from the library screen. The forward 

book is opened upon receiving a user-initiated event in which a 
portion of the forward graphical book representation 204 is 
selected. This user-initiated event can include/ for example, 
the user touching the front cover portion 208 of the forward 

10 graphical book representation 204 using his or her finger 212. 
In response to this user-initiated event, the book indicated by 
a title 214 is opened. If the book is previously unread, the 
book is opened to page one. If the book has been read before, 
the book opens to a page which was last read. 

15 FIG. 7 is an illustration of a first page of a book 

displayed on the touchscreen 130 upon exiting the library 
screen. To display the first page of the book, the machine- 
readable data representative of text and graphics from the book 
is read from either the removable machine-readable storage 

2 0 medium 136 installed in the electronic book, or from the 

internal machine-readable storage medium 154. Upon reading the 
machine-readable data, a page of the text and/or the graphics 
is then displayed on the touchscreen 130. As shown, the text 
is displayed to appear as a standard page in a real book. 

2 5 If a user-initiated event is received in which a user 

selects the second hot spot portion 178, i.e. the page back 
portion, of the touchscreen 130 when the book is on the first 
page, then a title page containing system controls is 
displayed. 

3 0 FIG. 8 is an illustration of a title page of a book 

displayed on an embodiment of the electronic book. Information 
which is displayed on the title page includes a book title 220, 
author information 222, copyright information 224, a Library of 
Congress number 226, and publisher information 228. Also 
3 5 displayed are statistics such as a total number of pages 230 in 
the book, a number of pages left to be read 232, and an elapsed 
reading time 234. 

A number of control options are also displayed. These 
control options include, but are not limited to, a pacing 



wo 97/22103 PCT/US96/19704 



control option 236, a font selection option 238, a system 
control option 240, a read-to-me option 242, and a radio 
frequency (RF) link option 244. Any of these control options 
can be initiated by a respective user-initiated event 
5 indicative of a user selecting the option. As illustrated in 
FIG. 8, a user is initiating a font selection routine by 
touching the font selection option 23 8 using his or her finger 
212. 

FIG. 9 is an illustration of a font selection page 
10 displayed on an embodiment of the electronic book. The font 
selection page is displayed upon an initiation of the font 
selection routine. 

Displayed on the font selection page are a number of 
font/size combination options. Each option is in the form of a 

1 5 word displayed using a specific font and a specific size in 

accordance with the font/size combination. A user selects a 
desired font/size combination by viewing how words appear in 
the various combinations, and selecting the combination which 
is desired. For example, in FIG. 9, the user is selecting a 

2 0 desired font/size combination by selecting a word 250 displayed 

in the desired font/size combination using his or her finger ' 
212. 

The fonts can be selected from internal fonts and custom 
fonts provided on the medium provided by a publisher. For 

2 5 example, a user may select a Gothic font provided on a medium 

containing a Shakespeare work instead of default fonts (e.g. 
Courier, Helvetica, Avant Garde) within the electronic book. 

Upon selecting the desired font/size combination, the 
electronic book automatically flips back to the title page 

3 0 containing the system controls. Thereafter, the electronic 

book uses the desired font/size combination as a primary 
font/size combination . to display the text of the book. Titles 
and headings in the book are enlarged and bolded based up>on the 
primary font/size combination. Other portions of text can be 
3 5 italicized based on the primary font. However, it is preferred 
that the body of the text never be displayed smaller than the 
size selected in the primary font/size combination. In some 
embodiments, it may be preferred to display footnotes in a size 
smaller than the size selected. 
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FIG. 10 is an illustration of the title page of the book 
which is displayed upon exiting the font selection page. Here, 
a user is shown to initiate a system control routine by 
selecting the system controls option 240 using his or her 
5 finger 212. 

FIG. 11 is an illustration of a system control page 
displayed in an embodiment of the electronic book. The system 
control page is displayed upon executing the system control 
routine . 

1 0 The system control page provides a number of display 

controls including a contrast control 254, a tint control 256, 
and a color control 258. Each of these controls provides a 
discrete number of control values which can be directly 
selected by a user. Further, each control value is displayed 

15 in a graphical manner consistent with the result of its 

selection. For example, the contrast control 254 includes a 
high contrast graphical representation 262, an intermediate 
contrast graphical representation 264, and a low contrast 
graphical representation 266. The graphical representations 

20 262, 264, and 266 are of the same graphical image, but are 
displayed using different contrast control values. Hence, a 
user can visually determine a desired contrast by viewing the 
graphical representations 262, 264 and 266. In a similar 
manner, the tint control 256 and the color control 258 each 

2 5 display a predetermined graphical image using a discrete number 

of tint control values and color control values, respectively. 

Preferably, the display of the graphical representations 
within the display controls are unaffected by current values of 
selected ones of the controls. In one preferred embodiment, 

3 0 the display of the graphical representations is independent of 

all of the current values. For example, the display of the low 
contrast representation 266 can be independent of the current 
contrast control value, the current tint control value, and the 
current color control value. In another preferred embodiment, 
3 5 the display of the graphical representations in each control is 
independent of the current value of that control, but depend on 
the current value of the other controls. Here, for example, 
the display of the low contrast representation 266 is 
independent of the current contrast control value, but 
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dependent upon the current tint control value and the current 
color control value. Using either of these two embodiments, a 
user can immediately determine a result of each control value 
selection before actually performing the selection. 
5 The system control page also includes a sound control 267 . 

The sound control 267 is illustrated to have a discrete number 
of sound intensity values which can be selected by a user. In 
the embodiment of FIG. 11, the sound intensity values are 
monotonically related to the size of an ear displayed on the 

10 sound control 267. An ear 268 having a slash therethrough is 
indicative of an option to turn off the sound. For the purpose 
of illustration, FIG. 11 shows a user selecting an intermediate 
sound intensity by touching an ear graphic 269. The user then 
returns to the system control page by touching the second hot 

15 spot portion 178, i.e. the page back hot spot, of the 
touchscreen 130. 

It is noted that the controls on the system control page 
can provide continuous, rather than discrete, control of the 
control values in alternative embodiments of the electronic 

2 0 book. Here, for example, the ear size and the volume can 
increase or decrease based on finger selection movement. 

A pad area 270 of the system control page is utilized for 
testing motions such as a hold event, a turn event, and a mark 
event- In particular, a user can point to. any of a hold 

2 5 selection 271/ a turn selection 272, and a mark selection 273, 

and then perform the selected motion in the pad area 270. 
Here, a length of hold time or style of dragging a finger for a 
flip command can be gauged for each user, for example, using 
the pad area 270. 

3 0 FIG. 12 is an illustration of the title page of the book 

which is displayed upon exiting the system control page. Here, 
the user is illustrated to select the read-to-me option 244 
which initiates the voice synthesizer 162 to audibly read the 
text being visually displayed on the touchscreen 130. The 
3 5 audible reading of the text begins at the last page which was 
displayed on the touchscreen 130. The reading rate and other 
controls for the read-to-me routine is provided on a pacing 
control page described hereinafter. 
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FIG. 13 is an illustration of the title page of the book 
wherein a radio frequency link option is selected. This option 
is selected by the user by touching the RF link option 244 
using his or her finger 212. Upon selecting the RF link option 
5 244, an RF link routine is executed. The RF link routine 
allows the user to download updates of the text to the 
electronic book, and/or to interface the electronic book to a 
personal computer or conununication unit. The RF link routine 
utilizes the antenna 158 and the RF modem 160 illustrated in 

10 FIG. 3 to communicate with the personal computer using a local 
wireless link, or more generally to communicate with a wireless 
data communication network. Utilizing a nationwide wireless 
data communication network, such as the Ardis network, allows 
individuals to receive book updates via radio frequency links 

15 in major cities. 

FIG. 14 is an illustration of the title page of the book 
wherein a pacing control option is selected by a user. 
Specifically, the user is shown to initiate a pacing control 
routine by selecting the pacing control option 236 displayed on 

2 0 the title page using his or her finger 212. 

FIG. 15 is an illustration of a pacing control page 
displayed in an embodiment of the electronic book. The pacing 
control page is displayed once the user selects the pacing 
control option 236 from the title page. The pacing control 

2 5 page includes a display 280 of a current reading pace of the 

user. Based upon the number of pages left in the book, which 
is given in a display 282, a display 284 of an estimated 
completion time for the book is also given. In the embodiment 
of FIG. 15, the current reading pace, the number of pages left, 

3 0 and the estimated completion time are displayed in the form of 

one or more sentences . 

Also displayed on the pacing control page is a display 290 
of a desired reading pace. A display 292 of an estimated 
completion time in accordance with the desired reading pace is 
3 5 also given. The desired reading pace is controlled by the user 
using a graphical slider bar 294. The pages of the text in the 
book are automatically paced by a pacing routine which is 
enabled and disabled by a graphical switch 296. In one 
embodiment, each page of text is displayed for a duration 
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commensurate with the desired reading rate controlled by the 
graphical slider bar 294. The user returns to the title page 
from the pacing control page by selecting the second hot SF>ot 
portion 17 B, i.e. the page back portion, of the touchscreen 
5 130. • 

FIG. 16 is an illustration of the title page of the book 
which depicts other user-initiated options. The user can 
return to a book-marked page by selecting the bookmark graphic 
182. The user can return to the library screen by selecting 

10 the fourth hot spot portion 184, i.e. the close book portion, 
of the touchscreen 130. The user can go to the first page of 
the book by selecting the first hot spot portion 170, i.e. the 
advance page portion, of the touchscreen 130. 

FIG . 17 is an illustration of a page marked by a dog ear 

15 in an embodiment of the electronic book. The user initiates a 
dog ear command by performing a predetermined user-initiated 
event. An example of such an event includes a user touching an 
upper corner portion of the touchscreen 130, such as the fifth 
hot spot portion 186 defined earlier. 

2 0 If the page is not dog-eared, then a brief touching of the 

upper corner portion 186 causes a dog ear graphic 300 to be 
displayed in the upper corner portion. In addition, an 
indication that this page has been dog-eared is stored either 
in the removable machine-readable storage medium 136 or the 

2 5 internal machine-readable storage medium 154 . 

If the user touches the upper corner portion 186 of a page 
already marked with a dog ear, or if the upper corner portion 
186 is held for a duration greater than a predetermined 
threshold, then a dog ear dialog box is opened. 

3 0 FIG. 18 is an illustration of a dog ear dialog box used in 

embodiments of the electronic book. A dog ear dialog box 302 
is displayed on touchscreen 130. The dog ear dialog box 302 
displays a list 304 of all dog-eared pages. A user can 
immediately go to one of the dog-eared pages on the list 304 by 
3 5 touching a display of a selected page number. 

The dog ear dialog box 302 also displays an option 306 to 
display marks 308 along an edge 310 of the page. Thereafter, a 
user can touch any of the marks 308 to move quickly to a 
corresponding one of the dog-eared pages. In the example 
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illustrated in FIG. 18, a mark 312 corresponds to marked page 
1, a dog ear 314 corresponds to marked page 35, a mark 316 
corresponds to marked page 94, a mark 318 corresponds to marked 
page 111, and a mark 320 corresponds to marked page 120. In a 
5 preferred embodiment, page one is always marked with a dog ear 
so that a user can quickly return thereto using either the 
marks 308 or the dog ear dialog box 302. 

Upon receiving a user-initiated event while the dog ear 
dialog box 302 is displayed, the dog ear dialog box 302 is 

1 0 removed to show the selected page of the book. 

FIG. 19 is an illustration of a user selecting a portion 
of a page of text. A portion 330 is selected by a user- 
initiated event of sliding his finger 212 (or other pointing 
member such as a stylus) from a first position 3 32 to a second 
15 position 334. Upon its selection, the portion 330 of the text 
is highlighted in a predetermined manner. The portion 330 of 
the text can be highlighted in color if the touchscreen 130 is 
capable of a color display. Alternatively, the portion 330 of 
the text can be highlighted using grey scale shading, reverse 

2 0 video, or underlining. An option selection dialog box is then 

displayed on the touchscreen 130 to provide the user a number 
of text marking options . 

FIG. 20 is an illustration of an option selection dialog 
box used in embodiments of the electronic book. An option 

2 5 selection dialog box 340 is displayed on the touchscreen 130 in 

a location out of the way of the portion 330 of the text that 
is marked when possible. The option selection dialog box 340 
includes a plurality of text marking options including a note 
capture option 342, a highlighting option 344, a quote capture 

3 0 option 346, and a set bookmark option 348. 

Briefly, the note capture option 342 allows a user to type 
in notes associated with the portion 330 of the text. The 
highlighting option 344 leaves the portion 330 of the text 
highlighted, and stores an indication of this highlighting so 
3 5 that any subsequent return to this page displays the portion 
330 as being highlighted. The quote capture option 346 allows 
a user to store the portion 330 of the text along with source 
data, such as the name of the author of the book or the title 
of the book, in the internal machine-readable storage medium 
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154. The set bookmark option 34 8 can be selected to add a 
bookmark to the current page. If the page already has a 
bookmark, then a number of bookmark management options similar 
to options used for the dog ear command are provided to the 
5 user. 

FIG. 21 is an illustration of an annotation display used ^ 
in embodiments of the electronic book. The annotation display 
is provided in response to a user selecting the note capture 
option 34 2 illustrated in FIG. 20. After receiving a user- 
10 initiated event indicative of selecting the note capture option 
342, a soft keyboard 360 is displayed on the touchscreen 130. 
The soft keyboard 360 -includes alphanumeric keys and symbolic 
keys along with a close key and a notes collection key. 

A plurality of keystroke events are received by the soft 
15 keyboard 360 to form an annotation. As the keystroke events 
are received, a plurality of characters corresponding thereto 
are displayed in a window 362 on the touchscreen 130. 

The user selects the close key on the soft keyboard 360 
upon completing the annotation. In response to selecting the 
2 0 close key, the electronic book removes the soft keyboard 360 

and the window 362 from the touchscreen 130 and displays a note 
marker icon to indicate that the page has an annotation 
associated therewith. 

The notes collection key on the soft keyboard 360 commands 

2 5 the electronic book to communicate the annotation to an 

external device such as a personal computer. The personal 
computer can be interfaced to the electronic book either 
wirelessly via the antenna 158 and the radio frequency modem 
160 shown in FIG.. 3, using a wire-based connection via the data-- 

3 0 interface 156, or using an infrared link. 

An annotation can also be in the form of an image of 
pixels which overlays the page of the text. The pixels can be 
drawn on the touchscreen 130 using a pointing device. The 
pixels can be stored in a pixel-map form for subsequent viewing 
3 5 or for subsequent conversion to text using a handwriting 
recognition method. 

As another option, an accessory keyboard can be added to 
the electronic book to enter the annotation as well as other 
information. 



wo 97/22103 PCT/US96/19704 

24 

FIG. 22 is an illustration of a marker used to indicate 
that a page has an annotation associated therewith. The page 
illustrated in FIG. 22 results after the user enters the 
annotation and selects the close key from the soft keyboard 360 
5 as illustrated in FIG. 21. As shown, the page in FIG. 22 no 
longer has the soft keyboard 360 and the window 362 displayed 
thereon. However, a note marker icon 370 is displayed in a 
lower corner of the page. The user can view the annotation 
associated with this page by selecting the note marker icon 

10 370. Selecting the note marker icon 370 has the same effect as 
selecting the note capture option 342 as shown in FIG. 20. 

Further, an annotation can be indicated by underlining or 
highlighting the portion of the text associated with the 
annotation. The annotation can be viewed in a hypertext -type 

15 manner by selecting the portion of text. 

FIG. 23 is an illustration of a user selecting a set 
bookmark option in the option selection dialog box. The user 
selects the set bookmark option 348 by touching the displayed 
text associated therewith using his or her finger 212 or other 

20 pointing member. If this page had already included a bookmark, 
then a bookmark management dialog box is displayed similar to 
the one used for the dog ear command. Since the page 
illustrated in FIG. 23 does not have a bookmark associated 
therewith, the selection of the set bookmark option 34 8 causes 

25 a bookmark to be added to the page. In a preferred embodiment, 
only one page is bookmarked within each book. 

FIG. 24 is an illustration of the page of FIG. 23 having a 
bookmark displayed thereon, A bookmark icon 380 is displayed 
in an upper portion of the page to indicate that the page has 

3 0 been bookmarked. 

It is noted that pointing devices other than an 
individual's finger may be utilized to generate user-initiated 
events indicative of desired selections using the touchscreen 
130. For example, a stylus or the like can be utilized to 

3 5 select desired portions of the touchscreen 130. 

It is also noted that various types of graphical controls 
can be utilized to control settings and parameters of the 
electronic book. These graphical controls include, but are not 
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limited to, graphical buttons, checkboxes, radio buttons, 
scroll bars, slider bars, pop-up menus, and dialog boxes. 

Next, a description of steps which are performed by the 
various components of the electronic book to provide its 
5 features and functionality is presented. These operational 
steps are performed on or with the aid of the processor 152 
illustrated in FIG. 3. The processor 152 is directed to 
function in a manner in accordance with these operational steps 
based upon a computer program or other form of software or 
10 firmware stored in a computer readable memory. The computer 

readable memory can be contained with the processor 152, within 
the internal machine-readable memory 154, or within a separate 
machine-readable storage medium in communication with the 
processor 152. 

15 It is noted that the order in which the steps are 

described are indicative of one embodiment of the present 
invention, and that alternative embodiments of the present 
invention may perform the steps in a different order to achieve 
the same functionality. ^ 

20 FIG. 25 is a flow diagram of an event loop performed in an 

embodiment of the electronic book. As indicated by block 4 pi), 
a step of executing a library graphical user interface routine 
is performed. The library graphical user interface routine 
provides a virtual library to allow a user to select a book to 

2 5 read from a plurality of books within a library, and/or access 

an information service or world-wide web page as previously 
described. The plurality of books can be contained in one or 
more removable machine-readedjle storage media and/or the 
internal machine-readable storage medium . 

3 0 Upon selecting a desired book^ a step of executing a 

routine to display one or more pages of text and graphics from 
the desired book is performed as indicated by block 402. The 
routine to display the pages of text is executed until a 
predetermined user-initiated event is received to exit the 
3 5 routine. As indicated by block 404, if a close book event is 
received, then flow of the event loop is directed back to the 
step of executing the library graphical user interface routine 
in block 400. 
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If a page back event, is received when the current page of 
text being read is page one, then a step of displaying a title 
page of the book is performed as indicated by block 406. The 
title page provides a number of control options available to a 
5 user. The user selects a desired control option based upon a 
user-initiated event. Block 408 indicates a step of receiving 
this user-initiated event. 

Based upon the user-initiated event which is received, 
flow of the event loop is directed to one of a number of 
10 subroutines in a step indicated by block 410. If the received 
event is indicative of the user selecting the pacing control 
option, then a step of executing a pacing control routine is 
performed as indicated by block 412. If the received event is 
indicative of the user selecting the font selection option, 

1 5 then a step of executing a font selection routine is performed 

as indicated by block 414. If the received event is indicative 
of the user selecting the system control option, then a step of 
executing a system control subroutine is performed as indicated 
by block 416. If the received event is indicative of the user 

2 0 selecting the RF link option, then a step of executing an RF 

link subroutine is performed as indicated by block 420. Upon 
completing either the pacing control subroutine/ the font 
selection routine, the system control routine, or the RF link 
routine, flow of the event loop is directed back up to block 

2 5 406 wherein the step of displaying the title page is performed. 

If the received event from block 408 is indicative of the 
user selecting the read-to-me option, then a step of executing 
a read-to-me routine is performed as indicated by block 422. 
Flow of the event loop is then directed back to block 4 02 to 

3 0 execute the routine to display pages of text from the book. 

The execution of the read-to-me routine in block 422 provides a 
spoken, auditory display of the text in addition to the visual 
display of the text in block 402. 

If the event received in the step of block 408 is an 
3 5 advance page event, then a step of setting the current page to 
page one is performed as indicated by block 424. If the 
received event is indicative of the user selecting a bookmark 
displayed on the title page, then a step of setting the current 
page to a previously bookmarked page is performed as indicated 
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by block 426. After the current page is set in either of the 
steps indicated by blocks 424 and 426, then flow of the event 
loop is directed back to the step of executing the routine to 
display pages of text indicated by block 402. 
5 Finally, if the event received in block 4 OB is indicative 

of a close book event, then flow of the event loop .is directed 
back to block 400 to perform a step of executing the library 
graphical user interface routine. 

FIG. 26 is a flow diagram of steps performed in an 

1 0 embodiment of a library graphical user interface routine for 

use in the electronic book. These steps can be performed in 
executing the library graphical user interface routine 
indicated by block 400 in PIG. 25. The steps provide a method 
of selecting a book for reading in an electronic book where the 
15 book is selected from a plurality of books in a library. 

As indicated by block 4 30, a step of displaying a rearward 
graphical book representation having a graphical spine portion 
is performed. A step of displaying a forward graphical book 
representation in front of the rearward graphical book 

2 0 representation is performed as indicated by block 432. The 

forward graphical book representation has a graphical spine 
• portion and a graphical front cover portion. 

As indicated by block 434, a step of displaying a title of 
a first book of the plurality of books on the forward graphical 

2 5 book representation is performed. The title of the first book 

can be displayed anywhere on the forward graphical book 
representation. However, in a preferred embodiment, the title 
of the first book is displayed on the graphical spine portion 
of the forward graphical book representation. FIG- 5 

3 0 illustrates an example of the rearward graphical book 

representation 200 having the graphical spine portion 202, the 
forward graphical book representation 204 having the graphical 
spine portion 206 and the graphical front cover portion 208, 
and the titlie 210 displayed on the forward graphical book 
3 5 representation 204. 

With reference again to FIG. 26, a step of receiving a 
first user-initiated event in which a portion of the rearward 
graphical book representation is selected is performed as 
indicated by block 436. In a preferred embodiment, the portion 
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of the rearward graphical book representation selected in this 
step is within the graphical spine portion of the rearward 
graphical book representation. Upon receiving the first user- 
initiated event, a step of displaying a title of a second book 
5 of the plurality of books is performed as indicated by block 
440. Preferably, the title of the second book is displayed in 
place of the title of the first book on the graphical spine 
portion of the forward graphical book representation. 
As indicated by block 442, a step is performed of 
1 0 receiving a second user-initiated event in which a portion of 
the forward graphical book representation is selected. In a 
preferred embodiment, the portion of the forward graphical book 
representation selected in this step is within the front cover 
portion of the forward graphical book representation. The 

1 5 reception of the second user-initiated event ends the execution 

of the library graphical user interface routine, and flow is 
directed to the routine to display pages of text from the 
second book. Here, steps are performed of reading machine- 
readable data from a machine-readable storage medium installed 
20 in the electronic book, the machine-readable data being 

representative of text from the second book, and displaying the 
text represented by the machine-readable data. 

It is noted that the steps indicated by blocks 436 and 440 
can be repeated to allow the user to rotate through the 

2 5 plurality of books. When the first user-initiated event is 

received while a last of the plurality of books is displayed, 
the next title displayed is that of the first of the plurality 
of books. 

It is preferred that steps of displaying and receiving 

3 0 user-initiated events all be performed using the touchscreen 

130 integrated in the electronic book. However, in alternative 
embodiments of the electronic book which include a series of 
buttons external to the touchscreen 130, any of the above- 
described user-initiated events may be received using these 
3 5 buttons . 

FIGS- 27 and 28 show flow diagrams of an embodiment of the 
routine to display pages of text in the electronic book. The 
steps indicated in these flow diagrams are performed in one 
embodiment of the step indicated by block 402 in FIG. 25. 
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Upon entering the routine, a step of displaying a current 
page of the book is performed as indicated by block 450. The 
current page includes text from the current page of the book, a 
graphical display of a number of pages remaining in the book, a 
5 display of a bookmark graphic if there is a bookmark associated , 
with the current page, a dog ear graphic if the current page is 
dog-eared, and a note marker icon if there is an annotation 
associated with the current page. Optionally, the current page 
includes graphics from the current page of the book. 

10 After displaying the current page, a branching step is 

performed, as indicated by block 452, based upon any user- 
initiated events which are received. If a user-initiated event 
is received which selects a portion of the text, a step of 
marking the portion of the text is performed as indicated by 

15 block 454. The portion of the text can be marked either by 
color or grey scale highlighting the portion of the text, 
underlining the portion of the text, or displaying the portion 
of the text in a reverse video form. The portion of the text 
can be selected directly by a user sliding a finger or a stylus 

20 over the portion of the text. Alternatively, the portion of 
the text can be selected indirectly by a menu selection 
technique. 

After the portion of the text has been marked, a step of 
displaying an option selection dialog box is performed as 

2 5 indicated by block 456. The option selection dialog box 

provides a plurality of options to the user, including a note 
capture option, a highlighting option, a quote capture option, 
and a set bookmark option. 

As indicated by block 460, a step of receiving a user- 

3 0 initiated event indicative of a selection of one of the options 

is performed. Based upon the selection, a branching step is 
performed as indicated by block 462. If the note capture 
option is selected, then a step of executing an annotation 
subroutine is performed as indicated by block 464. If the 
3 5 quote capture option is selected, then a step of executing a 
quote capture subroutine is performed as indicated by block 
466. If the highlighting option is selected, then a step of 
executing a highlighting subroutine is performed as indicated 
by block 470. If the set bookmark option is selected, then a 
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Step of executing a bookmark subroutine is performed as 
indicated by blocjc 472. 

Upon completing the execution of either the annotation 
subroutine, the quote capture subroutine/ the highlighting 
5 subroutine, or the bookmark subroutine, a step of determining 
whether a pacing mode is active is performed as indicated by 
block 474. If the pacing mode is inactive, then flow of the 
routine is directed back to block 452 which performs a 
branching step based upon a received user-initiated event. If 

1 0 the pacing mode is active , then a step of determining whether a 

highlighting mode is active is performed as indicated by block 
476. If the highlighting mode is active then a step of 
scrolling a highlight across the current page is performed as 
indicated by block 480. Scrolling the highlight across the 
15 current page allows pacing of a user's scanning across the 
current page. A user can activate the highlighting mode to 
help enhance his or her reading speed. 

The highlight which is scrolled across the page can be in 
the form of either a color or grey scale highlight, an 

2 0 underlining of text, or a reverse video form of text. If the 

touchscreen 130 is capable of selective backlighting, then the 
highlight can be in the form of a selective backlighting of a 
reduced portion of the touchscreen 130. 

After scrolling the highlight across the current page in 

2 5 block 480 or if the highlighting mode is inactive, then a step 

of determining whether it is time for displaying a subsequent 
page is performed as indicated by block 482. If the time has 
not yet come for displaying a subsequent page, then flow is 
directed back to block 452. If the time has arrived for 

3 0 displaying a subsequent page, then a step of updating the 

current page is performed as indicated by block 484. Next, a 
step of displaying a forward page turn in an animated matter is 
performed as indicated by block 486. This step includes 
displaying an animated sequence of images which simulates a 
3 5 forward flipping of a page. Flow of the routine is then 

directed back to block 4 50 to display the new current page. 

With reference to block 4 52, if a user-initiated event is 
received indicative of the user selecting the note marker icon, 
then the step of executing the annotation routine indicated by 



wo 97/22103 



PCT/US96/19704 



block 464 is performed. Thereafter, subsequent steps are 
performed beginning with the step indicated by block 474. 

With reference to the branching step performed in block 
4 52, if a dog ear user-initiated event is received, then a step 
5 of executing a dog ear routine is performed as indicated by 
block 490. If the user-initiated event is indicative of the 
user selecting the bookmark portion of the page, then a step of 
executing a bookmark management routine is performed as 
indicated by block 491. Thereafter, subsequent steps are 
10 performed beginning with the step indicated by block 474. 

Similarly, if no user-initiated events are received in block 
4 52, then flow of the routine is directed to the step indicated 
by block 474. 

If the user-initiated event is indicative of the user • 
15 selecting the page back portion of the page, then flow from, 
block 4 52 branches to a step of decrementing the current page 
as indicated by block 492. Further, a step of displaying a 
backward page turn in an animated matter is performed as 
indicated by block 494 . This step includes displaying an - 
2 0 animated sequence of images which simulates a backward flipping 
of a page. The steps indicated by blocks 486 and 494 give the 
user the sense or feel that a page of information is being 
turned in place, carrying forward the familiar paradigm of 
turning the page on a standard paper book. 

2 5 As indicated by block 4 96, a step of determining whether 

the new current page is the title page is performed after the 
step of block 494. If the new current page is the title page, 
then execution of the routine to display pages of text in the 
electronic book is completed as indicated by block 500. If the 

3 0 new current page is any page but the title page, then flow of 

the routine is directed back to block 450 wherein a step of 
displaying the new current page is performed. 

If the user-initiated event is indicative of the user 
selecting the advance page portion of the page, then flow is 
3 5 directed from the step indicated by block 4 52 to a step of 
incrementing the current page as indicated by block 502. 
Further, a step of displaying a forward page turn in an 
animated matter is performed is indicated by block 504 . Flow 
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of the routine is then directed back to block 4 50 wherein the 
new, incremented current page is displayed. 

FIG. 29 is a flow diagram of steps performed to display a 
current page in the electronic book. These steps constitute 
5 one embodiment of a method of performing the step indicated by 
block 450 in FIG. 27. 

As indicated by block 510, a step of displaying text from 
the current page of the book is performed. The text is 
displayed in accordance with a primary font parameter and a 
10 primary size parameter. If there is any highlighting 

associated with a portion of the text on the current page, then 
a step of displaying the portion of the text in a highlighted 
manner is performed as indicated by block 512. If any 
graphical information is included in the current page, then a 

1 5 step of displaying the graphical information is performed as 

indicated by block 513 . 

As indicated by block 514, a step of graphically 
displaying a number of pages remaining in the book is 
performed. The number of pages remaining in the book can be 

2 0 displayed in the sixth portion 188 of the touchscreen 130 as 

illustrated in FIG. 4. The number of pages remaining in the 
book can be graphically displayed using either an image of a 
number of pages, a dark line as a drop shadow, or a group of 
parallel lines to indicate relative depth by page number in a 
25 given document. When the current page is one of the early 

pages in the book, the drop shadow or graphical image depth is 
relatively deep, indicating that there is a significant portion 
of the book remaining to be read. When the current page is 
near the middle of the book, the drop shadow or graphical image 

3 0 depth is half as deep. When nearing the end of the book, the 

drop shadow or graphical image depth becomes very thin 
indicating that the reader is almost at the end of the book. 
As a result, the user can determine at a glance how much of the 
book has been read, and their relative position within the book 
3 5 just as a standard paper book. As an alternative to using a 
top portion of the touchscreen for graphically displaying the 
number of pages remaining in the book, a side edge and/or a 
bottom edge of the touchscreen 130 can be utilized to provide 
this graphical display. 
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As indicated by block 516, a step of determining if a 
bookmark is associated with the current page is performed. If 
a bookmark is associated with the current page, then a step of 
displaying a bookmark graphic is performed as indicated by 
5 block 520. ^ „ , 

As indicated by block 522, a step of determining if the 
current page is dog-eared is performed. If the current page is 
dog-eared, then a step of displaying a dog ear graphic is 
performed , as indicated by block 524. 
10 As indicated by block 526, a step of determining whether 

an annotation exists for the current page is performed. If 
there is an annotation associated with the current page, then a 
step of displaying a note marker icon is performed as indicated 
by block 530. 

1 5 FIG. 30 is a flow diagreun of steps performed in an 

embodiment of an annotation routine. Such an annotation 
routine is executed in the step indicated by block 464 in FIG. 
28. 

As indicated by block 540, a step of displaying a window 

2 0 for displaying the annotation is performed. As indicated by 

block 542, a step of displaying a soft keyboard on the 
touchscreen 130 is performed. The soft keyboard is provided to 
receive a plurality of keystroke events to form the annotation. 
After displaying the soft keyboard and the annotation 
25 window', a step of receiving a keystroke event is performed as 
indicated by block 544. As indicated by block 546, a branching 
operation is performed based upon the keystroke event received 
in block 544. If the keystroke event is indicative of the user 
selecting either an alphanumeric key or a symbolic key on the 

3 0 soft keyboard, then a step of displaying a character associated 

with the key is performed as indicated by block 560. The 
character associated with the key is displayed within the 
annotation window. After displaying the character, flow of the 
routine is directed back to block 544 wherein a subsequent 
3 5 keystroke event is received. 

Referring back to the branching step indicated by block 
54 6, if the keystroke event is indicative of a user selecting 
the close key from the soft keyboard, then a step of closing 
the soft keyboard is performed as indicated by block 562. A 
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step of closing the annotation window is also performed, as 
indicated by block 564. As indicated by block 566, a step of 
displaying a note marker icon on the page is performed. 
Thereafter, execution of the annotation subroutine is 
5 completed . 

With reference again to the branching step performed in 
block 546, if the keystroke event is indicative of the user 
selecting the notes collection key, then a step of 
communicating the annotation to an external personal computer 
10 is performed as indicated by block 570. After communicating 

the annotation to the personal computer, flow of the routine is 
directed back to block 544 wherein a subsequent keystroke event 
is received. 

FIG. 31 is a flow diagram of steps performed in an 
15 embodiment of a quote capture subroutine. Such a quote capture 
subroutine can be performed to provide the step indicated by 
block 466 in FIG. 28. 

Prior to entering the quote capture subroutine / a user- 
initiated event was received in the electronic book which 

2 0 selects a portion of the text displayed on the touchscreen. 

After receiving the user- initiated event, a plurality of text 
marking options, including a quote capture option, is 
displayed, and a user- initiated event indicative of a user 
selecting the quote capture option is received. 
25 As indicated by block 580, a step of storing quote data 

representative of the portion of the text is performed. The 
quote data is stored in the internal machine-readable storage 
medium 154 illustrated in FIG. 3. 

As indicated by block 582, a step of storing source data 

3 0 which identifies the source of the quote data is performed. 

The source data can be representative of the author of the 
book, the title of the book, a copyright date of the book, 
and/or a publisher of the book. The source data is stored in 
the internal machine-readable storage medium 154 from FIG. 3. 
3 5 As indicated by block 584, a step is performed of 

maintaining the quote data and the source data in the internal 
machine-readable storage medium when the removable machine- 
readable storage medium is removed from the electronic book. 
As a result of this step, subsequent steps can be performed 
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based upon the quote data and the source data when the 
removable machine-readable storage medium is removed. 
Specifically, a step of retrieving the quote data and the 
source data from the internal machine-readable storage medium 
5 can be performed when the removable machine-readable storage 
medium is removed from the electronic book. Thereafter, a step 
of displaying the portion of the text represented by the quote 
data and source information represented by the source data can 
be performed. 

10 FIG. 32 is a flow diagram of steps performed in an 

embodiment of a dog ear subroutine. Such a dog ear subroutine 
is executed in the step indicated by block 490 in FIG. 27. 

As indicated by block 590, a step is performed of 
determining a duration in which a dog ear portion of the 

1 5 touchscreen is held. A step of comparing the duration to a 

predetermined threshold is performed as indicated by block 592. 
The predetermined threshold can be about a second. If the 
duration is less than the predetermined threshold, then a step 
of determining whether the current page has a dog ear is 
20 performed as indicated by block 594. If the current page does 
not have a dog ear, then a step of storing an indication that 
the current page be dog-eared is performed as indicated by 
block 596. Further, a step of displaying a dog ear graphic in 
an upper corner portion of the touchscreen 130 is performed as 

2 5 indicated by block 600. Thereafter, execution of the dog ear 

subroutine is completed. 

With reference to blocks 592 and 594, if the duration is 
greater than or equal to the predetermined threshold or if the 
current page is already dog-eared, then a step of displaying a 

3 0 dog-eared dialog box is performed as indicated by block 602. 

Within the dog-eared dialog box, a list of all marked pages is 
displayed. Further, an option to show marks corresponding to 
all of the marked pages along an edge of each page is 
displayed. 

3 5 As indicated by block 604, a user-initiated event is 

received. As indicated by block 606, a branching step is 
performed based upon the user-initiated event received. If the 
user-initiated event is indicative of a user selecting a page 
number from the list of marked pages, then a step of setting 
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the current page to the selected page number is performed as 
indicated by block 610. If the user-initiated event is 
indicative of the user selecting the marking option, then a 
step of displaying marks corresponding to the dog-eared pages 
5 along an edge of the page is performed as indicated by block 
612. 

FIG. 33 is a flow diagram of steps performed in an 
embodiment of a pacing control subroutine. The pacing control 
subroutine is executed in the step indicated by block 472 in 
10 FIG. 25. 

As indicated by block 620, a step of determining a number 
of pages remaining in the book is performed. As indicated by 
block 622, a step of determining a current reading pace of the 
user is performed. 

1 5 Based upon the number of pages remaining in the book, a 

step of calculating one or more estimated completion times is 
performed as indicated by block 624. A first estimated 
completion time can be calculated by dividing the number of 
words or pages remaining in the book by the current reading 

2 0 pace of the user. As a result, the first estimated completion 

time estimates how long it would take the user to complete the 
book at his or her current reading pace. A second estimated 
completion time is calculated by dividing the number of words 
or pages remaining in the book by a desired reading pace. The 

2 5 second estimated completion time estimates how long it would 

take the user to complete the book at the desired reading pace. 

As indicated by block 626, a step of displaying each 
estimated completion time is performed. Each estimated 
completion time can be displayed within a corresponding 

3 0 sentence as illustrated in FIG. 15. 

As indicated by block 630, a step of calculating a 
necessary reading pace to satisfy a predetermined reading goal 
is performed. The predetermined reading goal can be in the form 
of a time duration within which a user wishes to complete the 
3 5 pages remaining in the book. Here, the necessary reading pace 
is calculated by dividing the number of pages remaining in the 
book by the time duration. A step of displaying the necessary 
reading pace to satisfy the reading goal is then performed as 
indicated by block 632. 
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AS indicated by block 634/ a step of displaying one or 
more graphical pacing controls is performed. As illustrated in 
FIG. 15. the one or more graphical- pacing controls can include 
a graphical slider bar such as the graphical slider bar 294 
5 used for modifying the desired reading pace, and a graphical 
switch such as the graphical switch 296 which is used for 
enabling and disabling an automatic pacing of the text using a 
pacing routine. 

As indicated by block 636, a user-initiated event is 
10 received. As indicated by block 640, if the user-initiated 

event is indicative of the user selecting the page back portion 
of the touchscreen 130, then execution of the pacing control 
subroutine is terminated. Upon terminating the pacing control 
subroutine, the system control page is displayed on the 
15 touchscreen 130. 

If the user-initiated event is not indicative of the user 
selecting the page back portion, then a step of updating a 
pacing parameter based on the user-initiated event is performed 
as indicated by block 642. Examples of the pacing parameter 
2 0 include the desired reading pace and the reading goal. After 
updating the pacing parameter, flow of the subroutine is 
directed back to block 624 to recalculate an estimated 
completion time and the necessary reading pace, 

FIG. 34 is a flow diagram of steps performed in an 

2 5 embodiment of the font selection subroutine. The font 

selection subroutine is executed in block 414 in the event loop 
of FIG. 25. 

As indicated by block 650, a step of displaying a 
plurality of words using a corresponding plurality of 

3 0 combinations of different fonts and different sizes is 

performed. More specifically, each word is displayed using a 
specific font and a specific size in accordance with the 
combination corresponding thereto. Optionally, the step of 
displaying the plurality of words can include displaying a 
3 5 respective font name for each of the combinations . As another 
option, the step of displaying the plurality of words can 
include displaying a single textual expression using the 
corresponding plurality of combinations. 
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As indicated by block 652, a step of receiving a user- 
initiated event indicative of the user selecting one word of 
the plurality of words is performed. This seJ.ection indicates 
which font/size combination is desired by the user, 
5 As indicated by block 654, a step of updating a primary 

font parameter and a primary size parameter is performed. The 
primary font parameter and the primary size parameter are 
updated in accordance with the font/size combination selected 
by the user. As indicated by block 656, a step of 

1 0 automatically returning to displaying the title page is 

performed after receiving the user- initiated event selecting 
the one word. Thereafter, a subsequent step of displaying text 
of a book includes displaying the text using the primary font 
in a size at least the primary size. 
15 FIG. 35 is a flow diagram of steps performed in an 

embodiment of the system control subroutine. The system 
control subroutine is executed in the step indicated by block 
416 in the event loop of FIG. 25. 

As indicated by block 660, a step of displaying a 

2 0 plurality of graphical controls for setting system parameters 

is performed. The system parameters can include display 
parameters such as a contrast parameter, a tint parameter, and 
a color parameter. The system parameters can also include a 
sound parameter. 

2 5 As indicated by block 662, a step of receiving a user- 

initiated event is performed. If the user-initiated event is 
indicative of the user selecting the page back portion of the 
touchscreen, as indicated by block 664, then execution of the 
system control subroutine is completed. For other user- 

3 0 initiated events, a step of updating a system parameter is 

performed as indicated by block 668. 

FIG. 36 is a flow chart of steps performed in a method of 
highlighting text in the electronic book. As indicated by 
block 700, a step of reading machine-readable data from a 
3 5 removable machine-readable storage medium installed in the 
electronic book is performed. As indicated by block 702, a 
step of displaying a page of text represented by the machine- 
readable data is performed. 
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A user-initiated event which selects a portion of the text 
to be highlighted is received in. the step indicated by block 
704 , The portion of the text is then displayed in a 
highlighted form as indicated by the step of block 706. If the 
5 text is displayed on a touchscreen integrated in the electronic 
book, the user-initiated event would include a user sliding a 
finger over the portion of the text on the touchscreen. 

After receiving the user-initiated event, a step of 
displaying a plurality of text marking selections, including a 
10 highlighting selection, is performed as indicated by block 708. 
A second user-initiated event indicative of a user selecting 
the highlighting selection is then received as indicated by 
block 710. If the text is displayed on a touchscreen 
integrated in the electronic book, the second user-initiated 
1 5 event includes a user touching a portion of the touchscreen 
associated with the highlighting selection 

As indicated by block 712, a step is performed of storing, 
in the removable machine-readable storage medium, an indicator 
of the portion of the text which is selected. The indicator of 
2 0 the portion of the text to be highlighted is stored in the 
removable machine-readable storage medium to remain with the 
text when the removable machine-readable storage medium is 
removed from the electronic book. 

Preferably, the indicator is in the form of at least one 

2 5 pointer which points to at least one location in the book which 

defines the portion of the text. Typically, each portion is 
defined by two indicators: one indicator pointing to a first 
word in the portion, another indicator pointing to a final word 
in the portion. Alternatively, a portion is defined by one 

3 0 indicator pointing to a boundary word (i.e. either the first 

word or the final word) of the portion and another indicator 
indicating the width of the portion. 

As indicated by block 714, a step of displaying a second 
page of the text other than the page containing the portion is 
3 5 performed. A step of redisplaying the page of the text 
containing the portion indicated by the indicator is then 
performed, as indicated by block 716. The portion of the text 
previously selected is displayed in the highlighted form. 
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Thus, there has been described herein a concept, as well 
as several embodiments including preferred embodiments of an 
electronic book having a highlighting feature. 

Because the various embodiments of the present invention 
5 provide a touchscreen integrated in a book- shaped housing which 
looks and feels like a real paper book, they provide a- 
significant improvement in that the user can comforably handle 
the electronic book and highlight text therein in a manner 
similar to a real paper book. 
10 Additionally, the various embodiments of the present 

invention store an indicator of a portion of the text to be 
highlighted in a removable machine -readable storage medium to 
remain with the text even if the removable medium is removed 
from the electronic book. 
15 It will be apparent to those skilled in the art that the 

disclosed invention may be modified in numerous ways and may 
assume many embodiments other than the preferred form 
specifically set out and described above. 

Accordingly, it is intended by the appended claims to 
2 0 cover all modifications of the invention which fall within the 
true spirit and scope of the invention. 
What is claimed is: 
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Claims 

1. An electronic book comprising: 

a book-shaped housing having a first housing meniber 
5 pivotably connected to a second housing member to open, and 

close in a book- like manner, the first housing member having a 
book-like front cover member, the second housing member having 
a book- like back cover member, the book- shaped housing defining 
a top edge, a bottom edge, and a foredge which are recessed 
10 with respect to the book-like front cover member and the book- 
like back cover member; 

an interface which receives a removable machine -readable 
storage medium containing machine- readable data representative 
of text from a book; 
15 a processor housed by the book- shaped housing and in 

communication with the interface to read the machine -readable 
data from the removable machine- readable storage medium; and 

a touchscreen integrated in the book- shaped housing to be 
accessible when the book- shaped housing is opened in the book- 
2 0 like manner, the touchscreen in communication with the 

processor to display a page of the text represented by the 
machine-readable data, the touchscreen operative to receive a 
user-initiated event in which a portion of the text is selected 
to be highlighted and to display the portion of the text in a 

2 5 highlighted form; 

wherein the processor stores an indicator of the portion 
of the text in the removable machine -readable storage medium, 
and wherein after the indicator is stored, the touchscreen 
displays a second page of the text other than the page 

3 0 containing the portion and subsequently redisplays the page of 

the text containing the portion indicated by the indicator, the 
portion being redisplayed in the highlighted form; 

wherein the indicator of the portion of the text to be 
highlighted is stored in the removable machine-readable storage 
3 5 medium to remain with the text when the removable machine- 
readable storage medium is removed from the electronic book. 
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2. The electronic book of claim 1 wherein the user- 
initiated event includes a user sliding a finger over the 
portion of the text on the touchscreen. 

5 3. The electronic book of claim 1 wherein after 

receiving the user-initiated event, the touchscreen displays a 
plurality of text marking selections including a highlighting 
selection and receives a second user-initiated event indicative 
of a user selecting the highlighting selection. 

10 

4. The electronic, book of claim 3 wherein the second 
user-initiated event includes a user touching a portion of the 
touchscreen associated with the highlighting selection. 

15 5. A method of highlighting text in an electronic book 

having a book-shaped housing, the method comprising the steps 
of: 

reading machine-readable data from a removable machine- 
readable storage medium installed in the electronic book, the 
2 0 machine-readable data representative of text from a book; 

displaying a page of the text represented by the machine- 
readable data; 

receiving a user-initiated event which selects a portion 
of the text to be highlighted; 

2 5 displaying the portion of the text in a highlighted form; 

storing, in the removable machine-readable storage medium, 
an indicator of the portion of the text which is selected; 

displaying a second page of the text other than the page 
containing the portion; 

3 0 redisplaying the page of the text containing the portion 

indicated by the indicator, wherein the portion is displayed in 
the highlighted form; and, 

wherein the indicator of the portion of the text to be 
highlighted is stored in the removable machine-readable storage 
3 5 medium to remain with the text when the removable machine- 
readable storage medium is removed from the electronic book. 

6. The method of claim 5 wherein the text is displayed 
on a touchscreen integrated in the electronic book, and wherein 
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the user-initiated event includes a user sliding a finger over 
the portion of the text on the touchscreen. 

7 . The method of claim 5 further comprising the steps 

5 of: 

after receiving the user-initiated event, displaying a 
plurality of text marking selections including a highlighting 
selection; and 

receiving a second user-initiated event indicative of a 
10 user selecting the highlighting selection. 

8. The method of claim 5 wherein the highlighted form is 
a reverse video form. 

15 9 . The method of claim 5 wherein the highlighted form is 

a color highlighting form. 

10. The method of claim 5 wherein the indicator includes 
at least one pointer. 



20 



wo 97/22103 



1/29 



PCT/US96/19704 




F/GJ 



SUBSTfTUTE SHEET (RULE 26) 



wo 97/22103 



2f29 



PCT/US96/19704 




F/G.2 



MACHINE- 
READABLBl 
STORAGE 
MEDIUM 



150 

INTERFACE 



130 



136 



TOUCH 
SCREEN 



ri62 



154- 



163- 



MACHINE 
READABLBi 
STORAGE 
MEDIUM 



VOICE 
SYNTHESIZER 



ACCESSORY 
INTERFACE 

BUS 



£8 



5 



'152 



156 



DATA 
INTERFACE] 



'163 



ACCESSORY 
INTERFACE 
BUS 



156^.^ 
^60 





RF 




MODEM 



^16 1 



IR 

TRANSCEIVER] 



FIG.3 



SUBSTITUTE SHEET (RULE 26) 



3/29 



PCT/US96/19704 




SUBSTITUTE SHEET (RULE 26) 



wo 97/22103 



4/29 



PCT/US96/I9704 




SUBSTITUTE SHEET (RULE 26) 



wo 97/22103 



5/29 



PCT/US96/19704 




SUBSTITUTE SHEET (RULE 26) 



wo 97/22103 



6/29 



PCr/US96/19704 




mt 



JSSS3L. 



Tin is aisMytypiufpaQt at laxtyoucan 

9fiB adjust tDOOftingfy. You can do a lot of 
olhtf Stings thii a/a stw^n in tioauM^ 
HMdi pfnonCiAon. 

Mfnf tfv Mafteff to Ats took 8 po^ to 

Oaooftsnofjbsfateoltttfvi 
inkasiiuchn k)tai$pubbHnQtnd 



X. ^ ca A) CQpftfa vid contnt &im^^^ 




F/a7 



S0BSnnfIESiiEEr(IHU26) 




FIG.8 

SUBSTITUTE SHEET (RULE 26) 



wo 97/22103 



8/29 



PCT/US96/19704 




SUBSTITUTE SHEET (RULE 26) 



wo 97/22103 



9/29 



PCT/US96/19704 



Statistics: 

TotPgs34S 

Lett 121 

Aeattingtime 1:10 
Psdng Conlnis 



Book We, AiOta, Copyhghl 
Utjfary of Congress number mid 
other pubHshff's marks. 




SUBSTITUTE SHEET (RULE 26) 



wo 97/22103 



10/29 



PCTAJS9d/19704 




FIG.11 



SUBSTITUTE SHEET (RULE 26) 



wo 97/22103 



11/29 



PCT/US96/19704 




Stattstci- 

TotPgsJiS 
Lett W 

ReaOngtime UW 
Psdng CotiMs 



Book Tdh, Author, CcpyrigtH 
tMary^CongrBssnjnterand 
ottm publisher ' % marks. 



Sysi&tv 

FotftSBtoebon 




\ 

130. 



FIG.12 



SUBSTITUTE SHEET (RULE 26) 



wo 97/22103 



12/29 



PCT/US96/19704 




Statfstes: 
PsoHQ Ccntrols 



Book Titte, Autha. CopyngNL 
L^nry of Congress number and 
other pub^sher's marks. 



System: 

fontSehction 
System Control 
RoadtoMe 





FIG. 13 



SUBSTITUTE SHEET (RULE 26) 



wo 97/22103 



13/29 



PCTAJS96/19704 




FIG. 14 



SUBSTITUTE SHEET (RULE 26) 



wo 97/22103 



14/29 



PCT/US96/19704 




m 



Vour cuTwf nading pace is 300^ 280 
WPM. At that rate you wS^sh the 
22lpages letting hrsandJS 
minutes. " V 

^284 

YoufsdectedpaceisSOO' ^290 

T^T pages ieft in approjomatefyO^ 
hts end 44 wn/tes. , 



292 



296 



Ojfrent reeling 
paceSOOWPM. 



280 



Desfed feading 
pace 600 W,PM 



^290 ^^f 




F/6. 



SUBSTITUTE SHEET (RULE 26) 



wo 97/221 03 PCT/US96/1 9704 

15/29 




FIG.16 



SUBSTITUTE SHEET (RULE 26) 



wo 97/22103 



17/29 



PCT/US96/197(M 




Relcom to the pages of 
f/Vhat we have been calling 
pjSooK tor digM Book, 
through tfiis presentation is 
wore or less concentrated 
on the reader, it is only to 




isskpartofOiereadm' 

system (ROS) and 
grqpft^ user in terfacfi^fGLHf: — ^ v 



r 



oppi/,^^ tomcvethe 



\ 



334 



\ 



FIG.19 



130 




FIG.20 



SUBSTITUTE SHEET (RULE 26) 



wo 97/22103 



PCT/US96/19704 



16/29 




^186 



5 



W^come to the paa^s^ 
What we have I 

Through thf 
moreorlel 
onthere 
desoijf 
isapaf 
operatingiy^ i (ROS) and 
graphical user interface (GUI). 

(^tester 




PrmarSy, we are 
irttmsted in creating the 
opportune to rrrove the 



300 



130 



FIG.17 



282 



Welcome to the pages Of 
What we have been caSng 
D BobkJorrSahalBoot 




MARKED PAGE UST: 
Go^Sstedpage^. 

^306 
Shqwhfif^ ears on pages 



li9y,weare 
(rested in creating the 
^^iportunityto move the 




FIG.18 

SUBSTITUTE SHEET (RULE 26) 



wo 97/22103 



19/29 



PCTAJS96/19704 




Welcome to the pages of I 
What we have been catSng 
DJSook, tor Book 
Through (te presentation © 
more or less concentrated 
on the reader, it is only to 
describe fwictionality that 
isapartofthere^ 
operating system (ROS) and 
graphical user interface (GUI). 



Text Mariong Selections: 



ies 1 
BookmarK^ 



Halts 
Qtaies 
Set 

interested tn cr 6^ 
opportunity tor 



FIG.23 





m7 



W^cometothepagesof \] 
What we have be&ica!by 
DJodc torO^talBook 
Throu^ this presentation is 
more or less concentrated 
on the reader, it is only to 
describe functirmSty that 
is a past of ttm reader 
opmting system (ROS) arvl 
grapNc^ user interface (GUI), 



PnmarSy,weare 
interested m creating the 
opportunity to move the 



580 



FIG.24 



SUBSTITUTE SHEET (RULE 26) 



wo 97/22103 



PCT/US96/19704 



18/29 




. . J' J J , ^ , , , 



Ttl 



271 



Welcome to the pages of 
What we have been calling 
D BQ<AJor digital Book 



note... here we 
reference the name D 
BookJ have an idea 
for the thing...! would 
callSEBookby 
Electronic Boole 



(^^sher 



FIG21 




ooooo 



'362 




mt 



Welcome to the pages of I 
What we have t)eenc^ng 
D_Book,for(£^BoolL 
Th/tnjgft tfi/s presentation is 
more or less concentrated 
on the reader, it is only to 
describe functionality that 
is a part of the reader 
operating system (ROS) and 
fftaphical user interface (GUI). 

fisher @ef 
^ brQbHer 

PrimarHy.weare 
interest in creatinn the 
opportum 



FIG.22 




SUBSTITUTE SHEET (RULE 26) 



wo 97/22103 



PCT/US96/19704 



21/29 

(^START^ 



^430 



DISPLAY A REARWARD GRAPHICAL BOOK REPRESENTATION \ 



DISPLAY A FORWARD GRAPHICAL BOOK REPRESENTATION | 



I 



434 



DISPLAY A TTTLEOFA FIRST BOOK ON THE 
FORWARD GRAPHICAL BOOK REPRESENTATION 



RECBVEA USERINTTIATED EVENT SELECTING A PORTION OF THE REAR- 
WARD GRAPHICAL BOOK REPRESENTATION 



^-440 



DISPLAY A TTTLEOFA SECOND BOOK ON THE FORWARD 
GRAPHICAL BOOK REPRESENTATK)N 



^442 



RECBVEA USERINmATED EVENT SELECVNG A PORTION OF THE FORWARL 
GRAPHICAL BOOK REPRESENTATION 



C BID ^ 

FIG,26 

SUBSnrUTE SHEET (ROLE 28) 



wo 97/22103 



PCT/US96/19704 



20/29 



8 



to 



3 
CD 

OC 




CM 

CD 

g: 



CO 




CD O S 
Uj ^ ^ ^ 



SUBSTITUTE SHEET (RULE 26) 



WO 97/22103 



PCT/US96/197(M 



23/29 



© © (6) Q 
^ 1^472 




® 



^505 



FIG.28 



SUBSTITUTE SHEET (RULE 26) 



wo 97/22103 



PCT/US96/19704 




suBsnnnESffiEr(n!iE2t) 



wo 97/22103 



PCTAJS96/I9704 



25/29 



START 



540 



DISPLAY ANNOTATION WINDOW 
WITH NOTES ASSOCIATED 
WTTH CURRENT PAGE 



542 



\ DISPLAY A SOFT KEYBOA^D~^ 



560. 



RECEIVE KEYSTROKE EVENT 



DISPLAY CHARACTER 
ASSOaATED WTTH KEY 



56?< 




■544 



570 



NOTES TO PERSONAL COMPUTERl 



mCTION 
KEY 



CLOSE SOFT KEYBOARD 



564 



2^ 



CLOSE ANNOTATION WINDOW 



566 



2i 



DISPLAY NOTE MARKER 



END 



FIG.30 



SUBSTITUTE SHEET (RULE 26) 



wo 97/22103 



PCTAJS96/19704 



24/29 




510 



DISPLA Y TEXT FROM CmBEHT PAGE 



J 



I 



513 



DISPLAY GRAPHICS FROM CURRENT PAGE 



3 



i ^ 512 

DISPLAY HIGHUGHTED TEXT ON CURRENT PAGE I 

J_ ^^514 



GRAPHICALLY DISPLAY NUMBER OF PAGES REMAININGj 



516 

^BOOKMARir^ YES 
FOR CURRENT 

JPAGEf^ 

[ 



NO 



1 ^^520 
miAYdOOKMAmGRAPHIC 




■524 



bi^^LAYOOG-EAR GRAPHIC 



526 

NOTES""'^^ VES 
FOR CURRENT^ 
PAGE? 



1 ^530 

I DISPLAY NOTE MARKER GRAPHIC I 



END 



FIG.29 



SUBSTITUTE SHEET (RULE 26) 



wo 97/22103 



PCT/US96/19704 



27/29 




590 



DETERMINE DURATION WHICH 
DOGEARPORWNISHELD 



<THRESHOLD 




>=THRESHOLD 



STORE PAGE NUMBER FOR 
DOG-EAR 



STORE PAGE NUMBER FOR 
DOG-EAR GRAPHIC ON PAGE 



600 



DISPLAYDIALOG 
MARKED PAGES 
SHOWDOG-B 


BOXUSTINGALL 
AND OPTION TO 
\RS ON PAGES 






RECEIVi 


EEVENfT 1 



T 
604 




DISPLAY MARKS ALONG EDGE OF 
PAGE TO ALLOW MOVE- 
MENT TO DOG-EARED PAGES 



SELECT PAGE 



^10 



SET CURRENT PAGE 
TO SELECTED PAGE 



END 

FIG,32 



SUBSTITUTE SHEET (RULE 26) 



wo 97/22103 



PCT/US96/19704 



26/29 




580 



I STORE QUOTE DATA REPRESENTATIVE OF THE PORTION OF THE TEXT \ 



STORE SOURCE DATA WHICH IDENTIFIES SOURCE OF THE QUOTE DATA 



1 



584 



M/mAIN THE CMTEDATA MID THE SOURCE DATA IN THE INTERNAL STORAOi 
UEOmmiENTHEREIMVABLESTOmGEMEDIUUISRBilOVED I 



FIG.31 



i END ^ 



STARl' 




'620 



DETERMINE NUMBER IF PAGES LEFT 



'622 



DETERMINE CURRENT READING PACE 



1 



624 



dALCULAT^ Estimated completion timeisi i 

A ^626 
I DI^PLA"/ estimated COMPLETION TIMES) I 

i ^630 

\CALCULKfE READING Pa6E TO SATISFY READING GOAB 

I DISPLAY READING PACE TO SATISFY READING GOAL 1 

i ^634 
DISPLAY GRAPHICAL PACING CONTROLS | 




UPDATE A PACING PARAMETER BASED ON 
THE USER-INITIATED EVENT 



FIG.33 



SUBSTITUTE SHEET (RULE 26) 



wo 97/22 103 



PCT/US9«/19704 



28/29 




^650 



DISPLAY A PLURAUTY OF WORDS USING A CORRESPONDING PLURAUTYOf\ 
COMBINATTONS OF FONTS AND SIZES I 



R^CBI v£ A SElhC Wti ok OF M }/vdF(b$ micA im — 



A DESIRED COmNAWN 



i ^654 
I UPDATE A PRIMARY FONT PARAMETER AND A PRIMARY SIZE PARAMETER'^ 

I AUTOMATICALLY RETURN TO TTTLE PAGE ~\ 



I 



FIG.34 



SUBSTITUTE SHEET (RULE 26) 



wo 97/22103 PCT/US96/19704 

29/29 




DISPLAY GRAPHICAL CONTROLS FOR L 680 
SETTING SYSTEM PARAMETERS f 



RECBVEA USER-INmATED EVavrV ^ FIG.35 



664^ 

PAGE 



BACK? ^ 



NO 



UPDATE A PACING PARAMETER . 
BASED ON THE USER-INTRATED EVENT r 



START 




READ DATA FROM REMOVABLE STORAGE MEDIIM^ TOO 



I , ^ 

DISPLAY A PAGE OF TEXT p ^ 



RECEIVE EVENT IN WHICH A PCmON OF THE TEXT IS SELECTED^ ^ 



D/SPM/ THE PORTION IN A HIGHUGHTED F0Rm\^ 706 



DISPLAY TEXT MARKING SELECTIONS p ^OB 



RECEIVE EVENT IN WHICH HIGHUGHTING SECTION IS SELECTEDf^^W 



STORE INDICATOR OF PORTION IN REMOVABLE STORAGE MEDIUMj^ 712 



1 



DISPLAY SECOND PAGE OFTEXTy 714 



REDISPLAY PAGE WTTH PORTION HI&iUGHTEDy 716 



F/6.36 



SUBSTITUTE SHEET (RULE 26) 



INTERNATIONAL SEARCH REPORT 



International application No. 
PCT/US96/19704 



A. CLASSIFICATION OF SUBJECT MATTER 
IPC(6) :G09C 5/00. 5/34; G09B 3/00, 17/00 

US CL : 345/121. 173, 901 ; 434/178.317 
According to tnicmationAl Patesst CUssiticalson (IPC) or to both nalioxuU clusiftcation and IPC 

B. RELDS SEARCHED 

Minimum documenuuion searched (cUau5caUoo syitem ibUowed by classification symbob) 

U.S. : 345/121, 173, 901; 434/178^17 

Documentation searched other than minimum documentation to the extent that such documents arc included in the fields .searched 



Electronic date base consuRed during the international search (name of dala base and. where practicable, search tenns used) 



C* DOCUMENTS CCMSIDEIIED TO BE RELEVANT 



Category* 


Citalioii of document, with indication, where appropriilc, of the relevant passages 


Relevant to claim No. 


Y 


US 5.475,398 A (YAMAZAKI et al) 12 December 1995. 


1-10 




columns 3-4. 




Y 


US 5.475.399 A (BORSUKl 12 December 1995. column 3 


1-10 




lines 43-56. 





Further documents are listed to the comimtttiDn of Boa C. FJ See patent &mily annex. 



Specml cittfona cM docMMM: T hier 4oa«B<t pbbl^nd >fter d>c ^ i iMiiiimt fiiat date er pooniy 

ID DC Cf pWQCWMJ RWVSOC 

OSMMBCnrf OOVCl ttf CMBOl DC ^IWWWf ftWI lO BVolvC SO BVCBtlVC CtCp 

*L' doonem vteich oar dtfow aoMta ea pnoniy ekiB(*) cr wfeick « wbca tfa> document m fckcn ttooc 
cNBd to eMMafa ike pufeticMiea date of wothrr date or ote 

wpnmi nman {m i^ified) *Y* iWhimiiiii of porticukr relevnce; Ifae claimed isvcatioo ceawt be 

ooieidcnd to nvoWe •& svatiw 9Up wWa Ifae docuiuc&i it 
*0' dociam tvfcfTiat *> m omI dackaoR, uio. nhftite or olfacr eeaktosd «idi one or mon ote Mb doasnti. tucfc oonbootioa 

bc«f obvious to t pcnnn nkiDod m the en 

•r docmoaAp^SAta ffwviihc m^ta^ docm^ monfcer of *e pMi fwaUy 
dv pf HM ity dele CMBMd 


Date of the actual completion of the tntemational search 
02 MARCH 1997 


Date of mailing of the international search report 

2 8 MAR 1997 


Name and mailing address of the ISA/US 
Commmioncr of Pateou and Tndemarks 

Box per 

Washington, D.C. 20231 
Facsimile No. r703) 305-3230 


Aulhi^opi^r^ 

<^NT CHANG 
Telephone No. (703) 305-4824 



Form PCT/lSA/210 (second sheet)(July 1992)* 



I 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 

REST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the originai 
documents submitted by the applicant. * 

/ 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SffiES 
FADED TEXT OR DRAWING 
BLURRED OR ILLEGIBLE TEXT OR DRAWING 

w SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: . 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



THIS mi BLANK (uspto) 



